Employing Linear Regression in Regression Tree Leaves
نویسنده
چکیده
The advantage of using linear regression in the leaves of a regression tree is analysed in the paper. It is carried out how this modiication aaects the construction, pruning and interpretation of a regression tree. The modiication is tested on artiicial and real-life domains. The results show that the mod-iication is beneecial as it leads to smaller classiica-tion errors of induced regression trees.
منابع مشابه
A simple regression based heuristic for learning model trees
The term “model trees” is commonly used for regression trees that contain some non-trivial model in their leaves. Popular implementations of model tree learners build trees with linear regression models in their leaves. They use reduction of variance as a heuristic for selecting tests during the tree construction process. In this article, we show that systems employing this heuristic may exhibi...
متن کاملApplication of ensemble learning techniques to model the atmospheric concentration of SO2
In view of pollution prediction modeling, the study adopts homogenous (random forest, bagging, and additive regression) and heterogeneous (voting) ensemble classifiers to predict the atmospheric concentration of Sulphur dioxide. For model validation, results were compared against widely known single base classifiers such as support vector machine, multilayer perceptron, linear regression and re...
متن کاملStepwise Induction of Model Trees
Regression trees are tree-based models used to solve those prediction problems in which the response variable is numeric. They differ from the better-known classification or decision trees only in that they have a numeric value rather than a class label associated with the leaves. Model trees are an extension of regression trees in the sense that they associate leaves with multivariate linear m...
متن کاملUsing Model Trees for Classi � cation
Model trees which are a type of decision tree with linear regression functions at the leaves form the basis of a recent successful technique for predicting continuous numeric values They can be applied to classi cation problems by employing a standard method of transforming a classi cation problem into a problem of function approximation Surprisingly using this simple transformation the model t...
متن کاملUsing Model Trees for Classiication
Model trees, which are a type of decision tree with linear regression functions at the leaves, form the basis of a recent successful technique for predicting continuous numeric values. They can be applied to classiication problems by employing a standard method of transforming a classiication problem into a problem of function approximation. Surprisingly, using this simple transformation the mo...
متن کامل